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THE  RELATION  OF  SPEED,  RANGE  AND  LEVEL  TO 
SCORES  ON  INTELLIGENCE  TESTS 


THE  PROBLEM 

Psychologists  in  general  believe  that  modern  intelligence  tests 
measure  native  intellectual  capacity.  Many  educators,  however, 
believe  that  scores  on  intelligence  tests  are  determined  less  by 
native  intellectual  power  than  by  other  factors  such  as  richness 
of  extra-school  environment,  the  individual’s  speed  of  reaction, 
and  the  quality  of  the  school  training.  Particular  objection  has 
been  made  against  the  time  or  speed  element  in  the  tests.  The 
problem  of  this  investigation  is  to  analyze  these  complex  instru¬ 
ments  by  determining  their  relationships  with  three  relatively 
clearly  defined  functions. 

Thorndike  has  suggested  that  one’s  score  on  a  standard  instru¬ 
ment  for  measuring  intelligence  is  in  a  degree  determined  by 
one’s  speed  of  reacting,  one’s  range  of  information ,  and  one’s 
general  power  or  level.  Let  us  call  these  aspects  of,  or  qualities 
of,  or  dimensions  of,  intelligence.  The  specific  problem  of  this 
investigation  is  to  determine  the  amount  of  the  associaton  be¬ 
tween  each  of  these  qualities  and  the  scores  made  by  180  pupils 
(grades  VII-XII)  on  the  Otis  Self  Administering  Group  Test, 
and  the  Terman  Group  Test,  and  the  Stanford  Revision  of  the 
Binet  Test. 

I.  THE  RELATIONSHIP  BETWEEN  SPEED  AND 
INTELLIGENCE 

Two  measures  of  speed.  The  two  measures  of  speed  used  in 
this  study  were:  (1)  the  speed  at  which  pupils  solved  arith¬ 
metical  problems  and  (2)  the  speed  at  which  they  “completed” 
sentences. 

SPEED  IN  SOLVING  ARITHMETICAL  PROBLEMS 

Each  of  the  180  pupils  was  tested  individually  on  the  7.  E.  R. 
Arithmetical  Problems,  Test  Al,  Bl,  Cl,  and  C2.  Stop  watch 
records  of  the  time  spent  by  each  pupil  on  each  test  element  in 
this  series  of  tests  constitute  the  data  for  speed  on  Arithmetical 
Problems.  Samples  of  the  tests  are  reproduced  here. 
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Speed,  Range,  Level  and  Intelligence  Test.  Scores 


SAMPLES  OF  THE  I.  E.  R.  ARITHMETICAL  PROBLEMS 
AAA  (7)  How  many  inches  are  there  in  2  feet  and  7  inches?  Answer — 
AA  (7)  What  is  the  cost  of  300  things  at  50  cents  a  hundred?  Answer — 
Al  (7'  What  number  subtracted  from  47  leaves  39?  Answer — 

B1  (7)  How  many  pencils  can  you  buy  for  50  cents  at  the  rate  of  2  for 
5  cents?  Answer — 

Cl  (7)  I  bought  4J/5  yards  of  cloth,  gave  the  clerk  $2  and  received  20 
cents  as  correct  change.  What  was  the  price  of  the  cloth  per 
yard?  Answer — 

C2  (7)  If  a  train  travels  half  a  mile  in  a  minute  what  is  its  rate  per 
hour?  Answer — 

In  securing-  a  measure  of  the  speed  at  which  pupils  solve  these 
examples,  it  seemed  desirable  not  to  include  test  elements  on 
which  there  was  a  large  number  of  incorrect  answers.  We  prefer 
to  have  a  measure  of  the  speed  at  which  pupils  do  these  tasks 
correctly.  Therefore,  after  scoring  the  test  elements  it  was  neces¬ 
sary  to  omit  Test  Cl  and  C2  because  of  the  large  number  of 
incorrect  responses.  In  general,  pupils  who  did  less  than  80% 
of  the  elements  of  Test  Al  and  Test  B1  were  excluded  from  the 
study.*  Originally  records  were  secured  on  192  pupils,  but 
owing  to  the  decision  to  exclude  cases  in  which  the  accuracy 
was  less  than  80%,  the  number  of  cases  was  reduced  to  180. 

Reliability  of  Scores  on  Speed,  in  Arithmetic.  In  order  to 
obtain  a  measure  of  the  reliability  of  the  scores  on  speed  in 
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♦There  were  9  exceptions;  no  case 
rect  answers  exceeded  40. 


vas  retained  if  the  percentage  of  incor- 
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arithmetical  problems,  the  median  number  of  seconds  spent  on 
the  elements  of  Test  A1  (Series  I)  was  correlated  with  the 
median  number  of  seconds  spent  on  the  elements  of  Test  B1 
(Series  II).  The  tabulated  results  of  the  scores  on  Series  I 
and  Series  II  are  given  in  Correlation  Table  1. 

The  raw  reliability  correlation  coefficient*  between  Series  I 
and  Series  II  is  .66,  while  the  corrected**  coefficient  is  .79. 

Correlations  between  speed  in  arithmetical  problems  and  the 
mental  ages  as  measured  bxj  the  Stanford  Revision  of  the  Binet 
Test.  Series  I  and  II  (arithmetical  speed)  were  combined,  and 
the  reciprocals***  of  the  results  correlated  with  the  mental  ages 
as  determined  by  the  Stanford  Revision  of  the  Binet  Test.  The 
tabulated  results  are  shown  in  Correlation  Table  2. 

CORRELATION  TABLE  2 
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The  raw  correlation  coefficient  between  speed  on  arithmetical 
problems  and  mental  age  on  the  Stanford-Binet  Test  is  .50 ;  the 
corrected  coefficient  is  .55.  It  thus  appears  that  speed  in  solving 
the  arithmetical  problems  in  Test  A1  and  Test  B1  is  positively 
and  significantly  associated  with  mental  age  as  measured  by  the 
Stanford-Binet  Test. 


•Pearson  Product  Moment. 

nr 

•♦Corrected  by  the  Spearman-Brown  formula  :rx  +  — - 

(»  —  1)  r  +  1 

•••The  scores  in  each  case  are  100  times  the  reciprocal  of  each  combined 
score. 
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Idle  relation  between  speed  in  arithmetical  problems  and  scores 
on  the  Terman  Group  Intelligence  Test.  Scores  of  Arithmetical 
Speed,  Series  I-II,  were  correlated  with  the  scores  on  the  Ter¬ 
man  Group  Intelligence  Test.  The  tabulated  results  are  shown 
in  Correlation  Table  3. 


CORRELATION  TABLE  3 
Arithmetical  Speed 
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The  raw  correlation  coefficient  between  speed  on  arithmetical 
problems  and  scores  on  the  Terman  Group  Test  is  .60;  the  cor¬ 
rected  coefficient  is  .67.  Thus  speed,  as  it  appears  in  the  solution 
of  arithmetical  problems,  is  more  closely  associated  with  scores 
on  the  Terman  Group  Test  than  with  the  Stanford-Binet  mental 
ages. 

The  relation  between  speed  on  arithmetical  problems  and 
scores  on  the  Otis  Self  Administering  Group  Intelligence  Test. 
Arithmetical  Speed,  Series  I-II,  was  correlated  with  the  scores 
on  the  Otis  S.  A.  Test.  The  tabulated  results  are  shown  in  Cor¬ 
relation  Table  4. 

The  raw  correlation  coefficient  between  speed  on  arithmetical 
problems  and  scores  on  the  Otis  S.  A.  Test  is  .63;  the  corrected 
coefficient  is  .71.  Speed,  therefore,  as  it  appears  in  the  solution 
of  arithmetical  problems  is  more  closely  associated  with  the 
scores  in  the  Otis  S.  A.  Test  than  with  the  scores  on  either  of 
the  other  two  intelligence  tests. 
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CORRELATION  TABLE  4 
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SPEED  IN  COMPLETING  SENTENCES 

■  Teat  Material  Used.  Each  of  the  180  pupils  was  tested  indi¬ 
vidually  on  the  I.  E.  R.  Completion  Tests  AAA,  AA,  Al,  B1 
and  B2.  Stop  watch  records  of  the  time  spent  by  each  pupil  on 
each  test  element  in  this  series  of  tests  constitute  the  data  for 
speed  on  Completion  Sentences.  Samples  of  the  tests  are  repro- 
ducd  here. 

SAMPLES  OF  I.  E.  R.  COMPLETION  TESTS 

AAA  (7)  Two  and  threee  make - 

AA  (7)  Water  is  - to  drink. 

Al  (7)  He  went  carefully  over  the  road  from - end  to  the - 

B1  (7)  The  dog - a  useful - because - his  intelli¬ 

gence  and  faithfulness. 

B 2  (7)  No - what  happens  wrong  is - right. 

Reliability  of  scores  on  Speed  in  Completing  Sentences.  To 
secure  a  measure  of  the  reliability  of  the  scores  on  speed  in  com¬ 
pleting  sentences,  the  median  number  of  seconds  spent  on  the 
odd  numbered  elements,  called  Series  I,  in  Tests  AAA  and  AA 
was  correlated  with  the  time  spent  on  the  even  numbered  ele¬ 
ments  in  these  tests,  Series  II.  The  tabulated  results  of  the 
scores  in  Series  I  and  Series  II  are  shown  in  Correlation  Table  5. 
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Speed,  Range,  Level  and  Intelligence  Test  Scores 


CORRELATION  TABLE  5 
Completion  Speed  1 
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The  raw  reliability  correlation  coefficient  between  Series  I 
and  Series  II  (.speed  in  completing  sentences)  is  .78;  the  cor¬ 
rected  coefficient  is  .88. 

The  correlation  between  speed  in  completing  sentences  and 
mental  age  (Stanf  ord-Binet) .  Correlation  Table  6  shows  the  re¬ 
lation  between  Completion  Speed  (Series  I-II)  and  Mental  Age 
(Stanf  ord-Binet). 

CORRELATION  TABLE  6 
Completion  Speed 
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The  raw  correlation  coefficient  is  .42 ;  the  corrected  coefficient 
is  .49,  slightly  lower  than  the  correlation  between  speed  on 
arithmetical  problems  and  mental  age  as  determined  by  the 
Stanford-Binet. 
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The  correlation  between  speed  in  completing  sentences  and 
scores  on  the  Terman  Group  Test.  Correlation  Table  7  shows 
the  relation  between  Completion  Speed,  Series  I  II,  and  Terman 
Group. 

CORRELATION  TABLE  7 
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The  raw  correlation  coefficient  is  .28 ;  the  corrected  coefficient 
is  .32.  Thus,  the  speed  at  which  180  pupils  complete  the  sen¬ 
tences  in  Test  AAA  and  AA  is  less  closely  associated  with  their 
scores  on  the  Terman  Group  Test  than  with  their  mental  age 
scores  on  the  Stanford-Binet. 
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Speed,  Range,  Level  and  Intelligence  Test  Scores 


Correlation  between  speed  in  completing  sentences  and  scores 
on  the  Otrs  S.  A.  Test.  Correlation  Table  8  suggests  the  relation 
between  Completion  Speed,  Series  I-II,  and  Otis  S.  A.  scores. 

The  raw  correlation  coefficient  is  .43 ;  the  corrected  coefficient 
is  .49.  There  is  the  same  degree  of  association  between  Comple¬ 
tion  Speed  and  Otis  S.  A.  as  there  is  between  Completion  Speed 
and  Stanford-Binet. 

Is  speed  in  solving  arithmetical  problems  closely  associated 
with  speed  in  completing  sentences t  We  have  secured  highly 
reliable  measures  of  the  speed  at  which  180  pupils  solve  arith¬ 
metical  problems  and  the  speed  at  which  they  complete  sen¬ 
tences.  The  data  are  based  upon  the  speed  at  which  pupils 
respond  with  an  accuracy  of  80%  or  greater,  except  in  9  in¬ 
stances.  If  the  speed  at  which  people  react  to  the  tasks  to  wffiich 
they  can  react  correctly  or  nearly  so,  is  a  fairly  constant  factor 
or  trait,  the  correlation  between  speed  on  Arithmetical  Problems 
and  speed  on  Completion  Sentences  should  be  high.  Correlation 
Table  9  suggests  the  relation  between  them. 


CORRELATION  TABLE  9 
(Completion  Speed) 


12 

15 

18 

21 

24 

27 

30 

33 

36 

39 

42 

45 

48 

14 

17 

20 

23 

26 

29 

32 

35 

38 

41 

44 

47 

50 

24-25 

22-23 

1 

"2  20-21 

2 

•£.  18-19 

1 

2 

1 

°°  16-17 

1 

2 

"s  14-15 

1 

4 

1 

6 

_ 

_ 

1  ■ 

1 

2 

•■K  12-13 

_ 

_ 

2 

5 

7 

3 

1 

6 

2 

1 

2 

_ 

1 

s  10-11 

_ 

_ 

4 

6 

3 

5 

_ 

9 

_ 

1 

_ 

1 

1 

■S  8-  9 

_ 

1 

4 

10 

8 

7 

5 

10 

3 

£  6-7 

3 

_ 

3 

8 

8 

5 

_ 

6 

_ 

1 

__  _ 

_ 

2 

^  4-  5 

1 

1 

1 

3 

1 

1 

2-  3 

— 

-- 

1 

-- 

1 

The  correlation  between  completion  speed  (I-II)  and  arith¬ 
metical  speed  (I-II)  is  .42;  the  corrected  coefficient  is  .50.  It 
thus  appears  that  arithmetical  speed  correlates  with  completion 
speed  less  closely  than  it  correlates  with  either  of  the  three 
intelligence  test  scores.  It  would  have  been  desirable  to  deter¬ 
mine  the  correlation  between  speed  in  handwriting,  speed  in 
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adding  single  columns,  and  the  like,  with  the  scores  on  the  intel¬ 
ligence  tests.  On  the  basis  of  our  limited  data,  however,  we 
question  the  following  hypothesis  of  Downey  :* 

“One’s  speed  of  movement  is  obviously  a  matter  of  consider¬ 
able  practical  importance,  since  it  determines  the  amount  of 
physical  work  that  one  can  put  through  in  a  given  time.  In 
trade-tests  and  in  vocational  tests  in  general,  speed  has  been 
recognized  as  a  factor  in  accomplishment  on  a  level  with  the 
factor  of  accuracy.” 

“In  another  connection  the  author  has  shown  that  graphic 
speed  is,  in  fact,  symptomatic  of  general  bodily  speed  of  move¬ 
ment.  It  has,  furthermore,  been  found  to  correlate  with  speed 
in  other  specific  activities  (rapidity  of  tapping  or  articulation, 
for  example)  ;  and  it  correlates,  as  will  be  shown  later,  with  all 
the  other  items  in  the  speed  group,  which  can  only  be  interpreted 
as  meaning  that  it  has  general  characterial  significance.” 

Summary.  We  have  found  the  following  amounts  of  correl¬ 
ation  between  speed  and  intelligence  scores : 

rar.  speed  and  Binet  M.  A.  =.55 


rco.  speed  and  Binet  M.  A.  =.49 

Mean  =.52 

rar.  speed  and  Otis  S.A.  =.71 

r  co.  speed  and  Otis  S.A.  =.49 

Mean  =.60 

I"ar.  speed  and  Terraan  group==-6l 
^co.  speed  and  Terman  group==-32 

Mean  =.495 


*The  Will-Temperament  and  Its  Testing,  page  86f. 


II.  THE  RELATIONSHIP  BETWEEN  LEVEL  AND 
INTELLIGENCE 


Meaning  of  “Level.”  We  are  investigating  the  relation  of 
speed ,  level,  and  range  of  information,  to  scores  made  on  three 
standard  intelligence  tests.  By  level  we  mean  the  ability  to  do 
difficult  tasks  in  solving  arithmetical  problems,  and  the  ability 
to  complete  sentences  of  increasing  difficulty.  Level  then  may  be 
thought  of  as  synonymous  with  power  or  difficulty. 

Test  materials  for  measuring  level.  Two  groups  of  tests  were 
used  to  secure  measures  of  level,  the  I.  E.  R.  Arithmetical  Prob¬ 
lems  Tests  and  the  I.  E.  R.  Completion  Tests.  The  Arithmetical 
Problems  Tests  contained  test  elements,  ranging  in  difficulty 
from  very  easy  problems  to  very  difficult  problems.  Samples  of 
the  test  elements  are  reproduced  here. 


SAMPLES  OF  I.  E.  R.  ARITHMETICAL  PROBLEMS 

D1  (7)  15  =  ...  X  4.  Answer - 

D2  (7)  11  =  ...  X  3.  Answer - 

El  (7)  In  1913,  a  certain  family  of  4  persons  spent  $12  per  month  per 
person  for  food  and  $28  per  month  for  the  whole  family  for 
rent.  What  did  they  spend  for  food  and  rent  for  the  whole 

year.  Answer - 

E2  (7)  18  =  .  .  .%  of  40. 

Fl  (7)  Four  men  buy  a  hundred  shares  of  stock  for  $4,000.  Brown  pays 
$1,600.  Jones  pays  $1,200,  Smith  pays  $800,  and  Thompson 
pays  $400.  How  many  shares  should  each  have?  Answer — 
F2  (7)  How  much  must  a  road  rise  in  each  100  feet  of  length  if  it  rises 

60  feet  in  2,000  feet  of  length?  Answer - 

Gl  (7)  On  June  22  the  sun  rises  at  4:30  and  sets  at  7:30.  What  per  cent 

of  the  24  hours  is  daylight?  Answer - 

HI  (7)  How  much  of  each  of  P,  N,  and  K  would  you  buy  to  make  a  ton 
containing  P,  N,  and  K  in  the  proportions  9,  8,  and  3,  respec¬ 
tively?  Answer - 

It  is  helpful  to  think  of  these  tests  as  constituting  a  ladder. 
A  pupil’s  score  is  determined  by  the  height  or  level  to  which  he 
can  climb  on  this  ladder  of  difficulty. 


Administration  of  tests.  These  tests  were  given  as  group 
tests.  Pupils  were  allowed  as  much  time  as  they  needed  to  go 
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as  far  through  the  test  series  as  their  power  permitted.  In 
general  2  class  periods  provided  sufficient  time  for  pupils  to 
reach  their  limit. 


Derivation  of  Measures  of  Level  in  Arithmetic.  The  elements 
in  these  tests  were  grouped  into  a  series  of  “levels”;  the  differ¬ 
ences  between  the  levels  being  about  equal.  This  work  was  done 
in  the  Institute  of  Educational  Research,  and  will  be  reported  in 
another  investigation. 

The  arithmetic  levels,  together  with  the  elements  comprising 
them,  as  determined  by  the  Institute  of  Educational  Research, 
are : 

,  .  (  Series  I— All,  A17,  B15,  Bll,  B12,  B17,  C12,  C13,  C24,  D21. 

Leve  0  iSeries  II— A12,  A19,  A14,  B16,  B14,  B18,  C18,  C21,  C27,  D23. 

,  ,  \  Series  I — Al3,  C22,  C23,  E16,  B13,  Cll,  C19,  D13,  D15,  E23. 

Level  jo  -j  Serjes  II — A 16,  B19,  C14,  C16,  C26,  C25,  D17,  D26,  D28,  D210. 

j  .  Series  I— B110,  C110,  C210,  Dll,  D12,  E19,  E21,  E25,  C29. 

Level  40  Serjes  n_ci4>  Cl7,  C28)  D14)  D16)  D19)  D18,  EHO,  E28,  E29. 

.  .  t  Series  I— D22,  D24,  D25,  E15,  E17,  F17,  F110,  F27,  F210,  G14. 

Levet  50  y  Series  n_D27>  D29j  E11  E27)  E210)  F18>  F23i  F24>  F26 

,  ,  ,  (  Series  I— D110,  E12,  F19,  F12,  F13,  F28,  F25. 

Leve’  oo  j  geries  n_E24)  E26j  E14j  E18)  F14>  F22t  F29 

.  .  j  Series  I— Fll,  Fl 5,  F21,  Gil,  G15,  G17,  G18,  G21,  G23,  G24. 

Level  70  j  geries  n_F16>  G12j  G19)  Gno  G27>  G28t  G29  (^210, 

G25,  G22. 

The  percentage  of  correct  responses  to  the  elements  in  each 
level  was  then  computed.  For  example,  one  pupil  was  scored 
as  follows : 

Level  20,  90%  ;  Level  30,  70%  ;  Level  40,  50%  ;  Level  50,  20%  ;  Level  60, 
0%  ;  and  Level  70,  0%. 

The  determination  of  level  scores.  Should  a  pupil’s  level 
score  be  the  point  up  to  which  he  does  practically  all  of  the 
examples  correctly?  Or  should  it  be  the  point  up  to  which  he 
does,  say,  50%  of  the  tasks?  The  number  of  pupils  who  passed 
the  lowest  level  with  100%  mastery  was  so  small,  that  it  would 
have  been  impossible  to  derive  a  score  for  level  if  we  had  insisted 
upon  100%  mastery  (correctness).  Consequently,  we  arbitrarily 
selected  the  level  up  to  and  on  which  the  pupils  did  50%  of  the 
elements.  In  a  later  paragraph  there  is  a  note  on  the  correla¬ 
tion  between  level  scores  on  an  80%  mastery  and  level  scores  on 
a  50%  mastery. 
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Rules  for  Determining  Level  Scores.  The  following  rules  were 
used  to  determine  level  scores : 

].  If  a  pupil  scores  50%  on  some  particular  level,  and  has  a  higher 
score  on  all  the  preceding  levels  and  a  lower  score  on  all  of  the  suc¬ 
ceeding  levels,  his  score  is  the  number  of  that  level. 

Unfortunately  for  the  convenience  of  scoring,  this  rule  applied  very 
infrequently. 

2.  When  rule  1  does  not  apply,  and  when  the  sum  of  the  successive 
scores  is  between  75  and  125,  the  mean  of  this  sum  is  added  to  the  lowest 
score  that  exceeded  50%. 

3.  If  a  pupil  scores  less  than  50%  on  some  particular  level,  and  higher 
than  50%  on  two  succeeding  levels,  he  is  not  penalized  for  that  particular 
low  score,  the  assumption  being  that  it  does  not  really  measure  his  power. 

Reliability  of  Measures  of  Arithmetic  Level.  As  was  suggested 
earlier,  two  measures  of  Arithmetic  Level,  Series  I  and  Series  II, 
were  secured.  The  amount  of  correlation  between  the  two  series 
is  suggested  by  Correlation  Table  10. 

CORRELATION  TABLE  10 
(Arithmetical  Level  I) 


2  4  6  8  10  12  1+  16  18  20  22  24  26  28  30  32 

3  5  7  9  11  13  15  17  19  21  23  25  27  29  31  33 


32-33  __  __  __  --  —  --  --  __  —  —  __  —  1  2  11 

30-31  __  --  __  --  --  __  —  --  1  1  —  __  2 

28-29  __  —  __  --  __________  1  1  6  4  3 

26-27  ______________  1  1  __  2  1  6  4  2  3 

24-25  _____________  1  1  __  1  2  3  3  1  2 

_  22-23  __  __  ______  1  __  2  2  __  __  2  3  2  —  2 

"  20-21  __  __  __  1  __  __  1  6  _-_  1  __  1  1  1  __  2 

•  i  18-19  ________  1  2  3  1  1  ._  2  __  __  1 

|  16-17  ____________  2  7  2  3  1  3  3  3  __  1 

-S  14-15  ______  1  __  1  2  3  2  1  1  __  __  __  __ 

'C  12-13  __  __  __  1  1  —  __  __  __  __  __  __  1  __ 

^  10-11  __  1  __  __  1  1  1  3  1  1  __  __  _.  _.  __ 

8-9  —  1  1  1  1  3  __  1  1  __  _.  __  ._  __ 

6-7  __  ______  1  3  2  —  —  1  1 . .  __  — 

4-5  1  2 _  __  3  __  —  __  __  —  —  __  ._  — 

2-3  1  ..  1  __  __  __  __  __  __  __  __  __  __  __  —  __ 

C-I  __  1  __  __  __  __  __  __  __  __  __  __  __  __  —  — 


The  raw  reliability  coefficient  between  Series  I  and  Series  II 
is  .77 ;  the  corrected  coefficient  is  .87. 

Correlation  between  Level  in  Arithmetic  and  Stanford-Binet 
Mental  Age. 

Is  level  or  power  in  solving  arithmetical  problems  closely  asso¬ 
ciated  with  scores  on  the  Stanford-Binet  Test?  The  relation¬ 
ship  between  them  is  suggested  by  Correlation  Table  11. 
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CORRELATION  TABLE  11 


Arithmetical  Level  I -II 


2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

290-9 

280-9 

1 

270-9 

1 

260-9 

1 

250-9 

2 

240-9 

1 

1 

2 

1 

3 

3 

230-9 

1 

2 

_ 

3 

2 

_ 

__ 

R 

220-9 

1 

2 

4 

1 

2 

2 

210-9 

1 

_ 

1 

2 

2 

2 

i 

5 

3 

3 

3 

200-9 

1 

1 

4 

4 

3 

1 

_ 

5 

5 

4 

_ 

_ 

R 

190-9 

_ 

1 

_ 

1 

1 

__ 

1 

4 

3 

4 

5 

4 

_ 

4 

2 

_ 

ftS 

180-9 

_ 

_ 

1 

2 

2 

3 

2 

6 

2 

3 

1 

1 

2 

170-9 

_ 

2 

1 

2 

1 

2 

2 

4 

_ 

2 

1 

2 

_ 

1 

_ 

_  _ 

160-9 

2 

_ 

1 

2 

3 

1 

2 

1 

3 

1 

__ 

150-9 

140-9 

1 

1 

The  Pearson  coefficient  of  correlation  between  level  in  arith¬ 
metic  and  Stanford-Binet  is  +  .57 ;  the  corrected  coefficient 
is  -f-  .65.  This  relationship  is  on  the  whole  closer  than  that 
existing  between  achievement  in  school  subjects  and  Stanford- 
Binet  scores.  It  is,  as  would  be  expected,  higher  than  the  cor¬ 
relation  between  speed  in  arithmetic  and  Stanford-Binet  (  +  .55). 

Correlation  between  Level  in  Arithmetic  and  Scores  on  the 
Terrnan  Group  Intelligence  Test.  The  correlation  between  level 

CORRELATION  TABLE  12 


Arithmetical  Level  /-// 


2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

210-9 

1 

2 

200-9 

2 

2 

1 

6 

190-9 

1 

_ 

_ 

2 

3 

_ 

3 

1 

180-9 

1 

2 

_ 

5 

6 

3 

1 

170-9 

2 

1 

2 

2 

1 

1 

4 

3 

3 

1 

_ 

160-9 

1 

_ 

__  _ 

2 

i 

2 

5 

3 

2 

1 

1 

1 

150-9 

1 

i 

3 

_  _ 

1 

4 

_  _ 

1 

_ 

140-9 

2 

__ 

__ 

2 

7 

3 

3 

1 

3 

1 

1 

_ 

R 

130-9 

_ 

1 

_ 

_ 

1 

3 

3 

1 

_ 

4 

_ 

_ 

1 

2 

_ 

_ 

5 

120-9 

_ 

1 

1 

2 

3 

1 

1 

1 

V. 

110-9 

_ 

_ 

2 

2 

_ 

1 

_ 

4 

1 

_ 

_ 

1 

•hi 

100-9 

1 

1 

1 

1 

_ 

2 

1 

1 

90-9 

1 

1 

1 

1 

2 

1 

_ 

1 

1 

_ 

_ 

80-9 

_ 

_ 

1 

1 

_ 

1 

70-9 

_ 

_ 

1 

_ 

_ 

1 

60-9 

2 

-- 

-- 

1 
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in  arithmetic  and  the  Terman  Group  Test  (see  Correlation 
Table  12)  is  considerably  higher  than  that  found  with  the  Stan- 
ford-Binet.  The  raw  coefficient  is  .74;  the  corrected  coefficient 
is  .80.  This  is  highest  correlation  thus  far  obtained. 

Correlation  between  Level  in  Arithmetic  and  Scores  on  the 
Otis  S.  A.  Test.  The  amount  of  the  correlation  between  Level  in 
Arithmetic  and  Otis  S.  A.  scores  is  suggested  by  Correlation 
Table  13. 

CORRELATION  TABLE  13 
Arithmetic  Level  I -II 


2  4  6  8  10  12  14  16  18  20  22  24  26  28  30  32 

3  5  7  9  II  13  15  17  19  21  23  25  27  29  31  33 


69-72  __  __  __  __  __  __  __  __  __  __  __  __  __  1  7 

.  65-68  __  __  .  1  __  1  4  3  3 

^  61-64  __  __  __  __  __  1  1  __  __  6  2  3  __ 

c<;  57-60  ______________  1  __  2  3  4  5  3  2  1 

53-56  ________  1  3  1  1  __  2  1  3  5  5  __  __ 

'5  49-52  __  __  __  __  1  1  __  4  2  3  3  4  3  1  __  __ 

^  45-48  __  __  1  __  __  __  3  7  5  4  1  2  1  __  1  __ 

1  41-44  1  1  —  2  2  3  5  5  __  1  1  __  1  __  — 

37-40  2  1  1  2  1  2  2  __  3  __  1  __  1  __  __ 

2  33-36  ______  5  1  3  1  1  1  1  ______  __  __  __ 

2  29-32  __  __  „  1  1  __  1  ._  __  __  __  __  __  __  __  __ 

^  25-28  __  __  I  __  —  __  __  __  __  —  __  —  __  __  __  __ 

21-24  2  —  __  __  __  __  __  —  __  __  __  __  __  __  —  __ 


The  raw  Pearson  coefficient  of  correlation  is  -f-  .74;  the  cor¬ 
rected  coefficient  is  -f-  .83. 

It  thus  appears  that  the  two  groups  tests,  Terman  and  Otis,, 
are  considerably  more  closely  associated  with  level  in  arithmetic 
than  is  the  Stanford-Binet. 

Each  of  these  tests  correlates  higher  with  Level  in  Arithmetic 
than  with  Speed  in  arithmetic.  This  fact  suggests  that  intelli¬ 
gence  tests  measure  something  that  is  more  closely  related  to  the 
type  of  mental  activity  involved  in  problem-solving  than  to  the 
more  habitual  or  more  automatic  kinds  of  responses.  In  fact 
there  is  a  prevailing  impression  that  intelligence  tests  measure 
primarily  that  type  of  mental  activity  which  we  call  power,  or 
ability  to  meet  novel  situations.  Later  sections  of  this  study  bear 
upon  this  issue. 

Before  proceeding  to  a  consideration  of  Level  in  Completion 
Sentences,  it  is  interesting  to  note  that  the  correlations  between 
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level  in  arithmetic  and  each  of  the  group  tests  is  nearly  as 
high  as  the  correlation  between  the  group  tests  themselves. 

Correlation  between  Ar.  Level  and  Terman__  .80 

Correlation  between  Ar.  Level  and  Otis _ .83 

Correlation  between  Otis  and  Terman _ .88 

Obviously  the  I.  E.  R.  Arithmetical  Problems  Test  would  be 
about  as  reliable  an  instrument  for  sectioning  or  classifying 
pupils  as  is  either  of  the  two  intelligence  group  tests.  If  the 
correlations  were  equally  high,  the  intelligence  tests  would  be 
preferable,  because  of  the  great  difference  in  the  time  required 
to  administer  them. 

The  fact  that  these  correlations  between  Level  in  arithmetic 
and  intelligence  test  scores  are  so  much  higher  than  those  usually 
found  between  Arithmetical  Reasoning  Tests  and  Intelligence 
Tests  may  be  accounted  for  by  the  fact  that  the  I.  E.  R.  Arith¬ 
metical  Problems  Tests  are  unusually  long,  about  two  class 
periods  being  required  to  take  them. 

THE  COMPLETION  LEVELS 

Measures  of  Completion  Level.  Measures  of  level  or  power 
to  complete  sentences  were  secured  by  using  the  I.  E.  R.  Comple¬ 
tion  Tests,  samples  of  which  are  reproduced  below.  These  tests 
were  given  in  the  same  manner  as  were  the  Arithmetical  Prob¬ 
lems  Tests. 

SAMPLES  OF  THE  I.  E.  R.  COMPLETION  TESTS 

D1  (7)  It  may - effort  and  a  long - but  the  result  is  sure. 

El  (7)  - is  natural  that  being  dissatisfied  with  the - ,  we 

should  form  a  too - estimate  of  the  past. 

E2  (7)  Enthusiasm  sometimes  might - the  Puritans  to  pursue  un¬ 
wise - ,  but - to  choose - means. 

E3  (7)  This  magazine  is  the - of  a  new  and  progressive  movement. 

FI  (7)  Stupid - will  usually — whatever - are - but  the 

kind  of  difficulties  felt  by - and  thoughtful  children - 

instructive. 

F2  (7)  The  words  ‘slave’  and  ‘right’  are - .  They  mutually  ex¬ 

clude  each  other. 

F3  (7)  Undue  consciousness  often — the  flow  of  expression - diffuse¬ 
ness  is  detrimental  to  a  clear  and - exposition  of  our  ideas. 

G1  (7)  The  human  race  may  be - as  parcelled — into  a - of 

distinct  groups - societies,  - greatly  in  size  and  cir¬ 

cumstances. 

G2  (7)  India  is  rich  in - of  scenery  and  climate,  - the 

- mountains  to  vast - deltas  raised - a  few 

- above  sea - . 
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G3  (7)  Farmers  brought  up  in  the  tradition  of  the - of  New  Eng¬ 

land,  on  going  where  close  association  and  co-operation  were 

- to  carry  on  irrigated  agriculture,  found  that  it  took  a 

long - and  involved - waste  to  learn - 

to  act - 

Hi  (7)  Life  is - short - run - possibilities;  we - 

have - . 

H2  (7)  The  most  abiding - free  government  is  to  get  large 

assemblies  to  work  promptly  and  smoothly -  - 

legislative  or  executive  purposes. 


Derivation  of  Measures  of  Level  in  Completion  Sentences. 
The  elements  in  these  tests  were  grouped  into  a  series  of  ‘‘levels,” 
the  differences  between  the  levels  being  about  equal.  This  work 
was  made  available  to  the  writer  by  the  Institute  of  Educational 
Research.  The  Completion  Levels,  together  with  the  elements 
comprising  them,  are : 

Irvrl  jo  l  Series  I_ ■ AAA7'  Al3’  Al6-  AA7- 

J  f  Series  II— AAA10,  A110,  A12,  AA8,  AA16. 

,  .VPl  ,n  \  Series  I — A 17,  All,  B1  3,  B17,  Bill,  B2+,  B29. 

4  I  Series  II— AlS,  B16,  B15,  B18,  B21,  B28,  B210. 

r  evel  i  Series  Dl6>  B23-  B14,  E110,  E21,  D110,  E21,  A19,  E26,  B26,  Bll. 
4  I  Series  II— A16,  E33,  B110,  E23,  D17,  B19,  E37,  E34,  B27,  B12. 

I  rvrl  On  \  Series  I — B 1 1 2,  E28,  Dl+,  E19,  D13,  D15,  D12,  E24,  D18,  G27. 

}  Series  II— E31,  Dll,  E28,  E15,  E25,  Ell,  D19,  E29,  G21. 
j. .  —  j  Series  I — El 8,  E17,  E22,  F24  F31,  F39. 

7  {  Series  II— F26,  F14,  E13,  E16,  F28,  G210. 

This  series  of  Completion  Levels  constitutes  a  ladder  or  diffi¬ 
culty  test.  Each  pupil  was  urged  to  climb  as  high  on  the  ladder 
as  he  could.  About  two  class  periods  were  required  by  the 
pupils. 


table  14 


Scores  on  Completion  Level  / 


14 

16 

18 

20 

22 

24 

26 

28 

30 

32 

34 

15 

17 

19 

21 

23 

25 

27 

29 

31 

33 

35 

34-35 

1 

2 

2 

e 

32-33 

1 

1 

2 

2 

1 

30-31 

1 

1 

_ 

1 

_ 

28-29 

1 

_ 

5 

2 

2 

4 

1 

S  £ 

26-27 

__ 

1 

_ 

_ 

5 

2 

3 

2 

3 

4 

_ 

© 

24-25 

1 

5 

6 

3 

1 

_ 

2 

_  _ 

c  s* 

22-23 

1 

_  _ 

5 

10 

8 

6 

4 

_ 

1 

_ 

20-21 

1 

2 

2 

13 

8 

3 

3 

<*■> 

18-19 

1 

1 

i 

4 

10 

_ 

1 

1 

16-17 

_ 

2 

i 

9 

5 

_ 

1 

14-16 

_ 

_ 

3 

_ 

1 

12-13 

— 

1 

— 

1 

1 
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Determination  of  Scores  of  Level  in  Completion  Sentences. 
The  same  procedure  that  was  used  in  the  Arithmetic  Levels  was 
used  here. 

Reliability  of  measures  of  Completion  Level.  The  reliability 
correlation  coefficient  between  Series  I  and  Series  II  was  -f-  .69; 
the  corrected  coefficient  was  -f-  .82. 

Correlation  between  Completion  Levels  I  II  and  Stanford- 
Binet  Scores.  As  in  the  case  of  the  Arithmetic  Level  and  the 
Stanford-Binet,  again  here  the  correlation  between  Completion 


table  15 

Completion  Level  I-II 

12  14  16  18  20  22  24  26  28  30  32  34 

13  15  17  19  21  23  25  27  29  31  33  35 


•  5 


290-9 

280-9 

270-9 

260-9 

250-9 

240-9 

230-9 

220-9 

210-9 

200-9 

190-9 

180-9 

170-9 

160-9 

150-9 

140-9 


1 

1 

1 

_  __  __  __  __  __  __  2  — 
.  __________  2  1  5  2  1 

__  __  1  1  1  2  3 

_  2  2  2  2  3  1 

__  3  4  4  6  5  1 

3  8  8  5  3  1 

1  3  11  5  8  1  ______  1 

1  3  5  10  4  2  —  —  — 

2  8  4  3  2  1 

3  3  5  4  1  __________ 


1  1 


Level  I-II  and  Stanford-Binet  is  .65  (raw  .57).  The  writer 
was  of  the  opinion  that  the  abilities  involved  in  completing  sen¬ 
tences  were  more  directly  associated  with  the  abilities  measured 
by  intelligence  tests  than  were  the  abilities  involved  in  solving 
arithmetical  problems. 

Correlation  between  Completion  Levels  and  Terman  Group 
Scores.  The  coefficient  of  correlation  between  scores  on  comple¬ 
tion  Levels  I-II  and  Terman  Group  scores  is  -)-  .59 ;  the  corrected 
coefficient  is  +  .66.  The  Terman  Group  test  and  the  Stanford- 
Binet  are  influenced  about  equally  by  the  abilities  involved  in 
completing  sentences. 
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table  16 


Completion  Level  (Composite) 


14 

16 

18 

20 

22 

24 

26 

28 

30 

32 

34 

15 

17 

19 

21 

23 

25 

27 

29 

31 

33 

35 

210-9 

2 

1 

200-9 

i 

1 

4 

1 

3 

1 

190-9 

i 

1 

4 

3 

1 

180-9 

3 

2 

3 

5 

4 

1 

170-9 

_ 

_ 

1 

1 

i 

6 

3 

3 

3 

1 

1 

160-9 

_ 

1 

1 

5 

3 

5 

2 

1 

1 

150-9 

_ 

_ 

2 

2 

6 

1 

140-9 

_ 

_ 

4 

8 

11 

130-9 

_ 

__ 

1 

8 

4 

3 

t; 

120-9 

__ 

2 

2 

3 

2 

4 

“V 

f-, 

110-9 

_ 

2 

3 

4 

__ 

2 

100-9 

_ 

1 

5 

2 

90-9 

1 

2 

2 

3 

i 

80-9 

_ 

_ 

2 

i 

70-9 

_ 

i 

__ 

I 

60-9 

-- 

-- 

i 

Correlation  between 

Completion  Levels 

/ -II  and  • 

Otis 

S.  A. 

Test. 

The  raw 

coefficient  of  correlation 

between  < 

Completion 

Level 

(I-II)  and 

Otis  f 

8.  A 

.  is 

+ 

.55; 

corrected 

for 

attenuation, 

TABLE  17 

Completion  Level  (Composite) 

14 

16 

18 

20 

22 

24 

26 

28 

30 

32 

34 

15 

17 

19 

21 

23 

25 

27 

29 

31 

33 

35 

73-76 

69-72 

1 

1 

3 

2 

1 

65-68 

1 

2 

4 

2 

1 

1 

1 

_  _ 

61-64 

1 

__ 

5 

2 

5 

_ 

_ 

_  _ 

57-60 

_ 

_ 

1 

1 

3 

1 

3 

7 

3 

1 

1 

53-56 

_ 

_ 

2 

7 

4 

4 

2 

1 

2 

_ 

_ 

C/3 

49-52 

_ 

1 

3 

7 

5 

4 

_ 

1 

_ 

1 

_ 

45-48 

_ 

1 

4 

5 

7 

4 

5 

_  _ 

1 

_ 

_ 

O 

41-44 

1 

1 

1 

10 

4 

5 

37-40 

_ 

3 

4 

3 

6 

33-36 

__ 

3 

7 

3 

29-32 

3 

25-28 

__ 

_ 

1 

21-24 

— 

— 

1 

1 

v  —  -f-  .61.  This  result  agrees  very  closely  with  the  other 
results.  With  the  two  group  intelligence  tests,  the  correlations 
between  Completion  Level  and  Intelligence  Scores  are  consider¬ 
ably  lower  than  were  found  in  the  case  of  Arithmetic  Level. 
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Summary.  The  following  correlations  between  Level  and  In¬ 
telligence  Scores  have  been  secured. 


r 

r 

r 

r 

r 

r 


ar.  level  and  Binet  = 
ar.  level  and  Terman  = 
ar.  level  and  Otis  = 

co.  level  and  Binet  = 

co.  level  and  Terman  = 

co.  level  and  Otis 


:  .65 
.80 
.83 
.65 
.66 
-  .61 


III.  THE  RELATIONSHIP  BETWEEN  INFORMATION 
AND  INTELLIGENCE 

The  third  phase  of  our  problem  is  to  determine  to  what  extent 
general  information  correlates  with  each  of  the  three  intelligence 
test  scores. 

Measures  of  Information.  To  secure  measures  of  information 
for  each  of  the  180  pupils,  the  I.  E.  R.  Information  Tests  were 
employed.  Samples  of  these  tests  are  reproduced  here. 


tasteless, 
cattle 
four 


SAMPLES  OF  1.  E.  R.  INFORMATION  TESTS 
Al  (7)  The  kidneys  are  in  the  head  chest  neck 
B1  (7)  The  airplane  was  invented  in  Italy  United  States 
Austria. 

Cl  (7)  Hydrogen  tastes  sweet  sour  bitter 
Dl  (1)  The  Ayrshire  is  a  kind  of  fowl  fruit 
D2  (7)  The  numbers  of  cylinders  in  the  Cadillac  is 
eight  twelve. 

El  (7)  From  Paris  to  Berlin  is  about  400  miles 
1,000  miles  1,300  miles. 

E 2  (7)  Queen  Elizabeth  of  England  was  born  about 
1625  1725. 

Fl  (7)  The  number  of  a  crab’s  legs  is  four  six 

G  (7)  The  color  of  bromine  vapor  is  violet  green 

white. 


abdomen. 

Spain 

fish. 

six 


700  miles 

1425  1525 

eight  ten. 
brown 


TABLE  18 


Information  Series  l 


12 

1 1 

14 

13 

16 

15 

18 

17 

20 

19 

22 

21 

24 

23 

26 

25 

28 

27 

30 

29 

32 

31 

34 

33 

36 

35 

35-36 

2 

3 

1 

2 

33-34 

3 

3 

3 

2 

_ 

31-32 

5 

3 

1 

4 

_ 

_ 

29-30 

7 

3 

7 

4 

_ 

_  _ 

27-28 

1 

2 

2 

5 

7 

2 

_ 

_ 

£ 

25-26 

2 

5 

4 

6 

3 

2 

1 

_ 

23-24 

1 

1 

6 

6 

5 

_ 

2 

1 

_ 

_ 

21-22 

__ 

__ 

1 

1 

1 

2 

5 

6 

3 

1 

19-20 

_ 

1 

_ 

3 

4 

6 

1 

_ 

2 

17-18 

2 

3 

9 

3 

© 

15-16 

__ 

2 

__ 

_ 

1 

l 

1 

1 

1 

'tp 

13-14 

i 

2 

l 

11-12 

1 

_ 

i 

_ 

1 

9-10 

_ 

_ 

i 

7-8 

— 

— 

i 

Information  and  Intelligence 


21 


As  with  speed  and  level,  in  order  that  the  reliability  of  the 
measures  of  information  might  be  known,  two  series  of  measures 
were  obtained.  Series  I  was  the  sum  of  the  correct  responses  to 
Tests  Al,  Cl,  D2  and  FI.  Series  II  was  the  sum  of  the  correct 
responses  to  Tests  Bl,  Dl,  El  and  E2. 

Reliability  of  Measures  of  Information.  The  raw  r  between 
Series  I  and  II  is  .69 ;  the  cerrected  r  is  .82.  Correlation  Table  18 
suggests  the  correlation. 

Correlation  between  Information  Scores  and  Stanford-Binet 
Mental  Ages.  The  coefficient  of  correlation  between  Information 
I-II  and  Stanford-Binet  Mental  Age  for  the  180  pupils  (see 
Table  19)  was  found  to  be  .58;  the  corrected  coefficient  is  -f- 
.71.  Thus  Stanford-Binet  correlates  slightly  higher  with  Infor¬ 
mation  that  with  either  of  the  measures  of  Speed  or  either  of  the 
measures  of  Level. 

table  19 

Information  I-II 


10  12  14  16  18  20  22  24  26  28  30  32  34 

11  13  15  17  19  21  23  25  27  29  31  33  35 


280-9  __  __  __  __  __  __  __  __  __  __  1 

270-9  __  __  __  __  __  __  __  __  1  ..  ..  __ 

260-9  __  __  __  __  __  __  __  __  1 

250-9  __  __  __  __  __  __  __  __  __  1  1 

.  240-9  __  __________  1  1  5  1  3 

^  230-9  _.  __  _.  __  ______  2  2  2  2  — 

^  220-9  __  ._  ________  1  2  3  4  2 

_  210-9  ________  1  2  2  2  4  6  4  2  — 

£  200-9  ______  1  3  3  6  5  3  4  2  1 

(5  190-9  ________  1  3  5  3  6  7  5 

180-9  1  3  __  1  3  5  4  3  3  1 

170-9  __  1  __  __  4  3  2  7  3 

160-9  1  1  __  1  4  1  3  3  _.  1  1 

150-9  __  _.  __  __  __  „  __  __  __  —  —  __  — 

140-9  __  1  1 


Correlation  between  Information  Scores  and  the  Terman 
Group  Scores.  The  coefficient  of  correlation  between  Informa¬ 
tion  I-II  and  Terman  Group  Scores  (see  Table  20). 
is  -)-  .69 ;  corrected  for  attenuation,  the  coefficient  correlation 
is  +  .74.  The  correlation  between  Arithmetic  Level  I-II  and 
Terman  is  .80.  Between  Completion  Level  I-II  and  Terman 
r  =  .66.  The  mean  of  these  correlations  is  .73,  practically  the 
same  as  the  correlation  between  Information  I-II  and  Terman. 
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table  20 

Information  I-II 


11  13  15  17  19  21  23  25  27  29  31  33  35 

10  12  14  15  18  20  22  24  26  28  30  32  34 


210-9  __  __  __  __  __  __  __  __  __  __  1  2 

200-9  ...  __  __  __  __  2  4  3  2 

190-9  __  __  __  __________  2  2  2  3  1 

2  180-9  __  __  __  ______  1  2  13  1  1 

$  170-9  ________  2  —  1  3  6  5  3 

^  160-9  __________  2  4  4  2  4  3 

S'  150-9  ________  1  1  1  2  2  2  2 

£  140-9  1  __  5  4  4  4  2  2  1 

^  130-9  2  1  3  4  1  4  1 

*  120-9  ._  __  1  2  2  6  2  — 

|  110-9  __  __  1  —  1  3  4  1  2 

£  100-9  __  1  1  1  4 

90-9  1  1  1  5  1 

80-9  __  __  __  1  1  1 

70-9  __  __  __  __  __  __  __  1  1 

60-9  ._  2  1 


Correlation  between  Information  Scores  and  Otis  S.  A.  Scores. 
The  coefficient  of  correlation  between  Information  I-II  and  Otis 
S.  A.  Scores  (see  Table  21)  is  -f-  .66;  corrected  for  attenuation, 


TABLE  21. 
Information  I-II 


1  1  13  15  17  19  21  23  25  27  29  31  33  35 

10  12  14  16  18  20  22  24  26  28  30  32  34 


69-72  __  __  __  ________  1  1  2  4  1 

65-68  __  __  ________  1  2  5  2  1 

61-64  __  ____________  2  3  2  2  3  1 

57-60  ________  2  __  1  3  4  7  3  2  2 

-J  53-56  2  4  1  3  8  3 

.  49-52  1  1  1  2  5  3  4  4 

60  45-48  ________  1  5  3  5  3  4  4  — 

•5  41-44  __  1  3  2  7  5  1  2  __  — 

37-40  1  1  __  1  4  3  2  2  1  1  —  —  — 

33-36  __  1  1  1  1  3  4  1  1 

29-32  1  1  __  __  1  ._  __  __  __  __ 

25-28  __  __  ._  __  1  __  __  __  __  __  __  —  __ 

21-24  __  1  1 


r  =  -f-  .71.  We  recall  that  the  correlation  between  Arithmetic 
Level  and  Otis  is  .83 ;  between  Completion  Level  and  Otis,  r  = 
.61.  The  mean  of  these  two  correlations  is  .72,  practically  iden¬ 
tical  with  the  correlation  between  Information  I-II  and  Otis  S.  A. 
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Summary.  On  the  assumption  that  our  measures  of  Infor¬ 
mation  may  be  regarded  as  being  sufficiently  broad  and  general 
to  give  a  statistically  sound  sampling  of  these  pupils’  general 
information,  the  following  conclusions  are  valid : 

1.  General  information  is  slightly  less  closely  related  to  what  the  Stan- 
ford-Binet  test  measures  than  is  Arithmetic  Level  or  Completion  Level. 

2.  General  Information  is  slightly  less  closely  related  to  what  the  Otis 
S.  A.  Test  measures  than  is  Arithmetic  Level  and  slightly  more  closely 
related  to  it  than  is  Completion  Level. 

3.  General  Information  correlates  with  the  Terman  Group  test  in  almost 
the  same  degree  as  it  does  with  the  Otis  test. 

It  appears,  therefore,  that  Information  and  Power  (Level)  are  about  equal 

in  the  extent  to  which  they  are  related  to  these  intelligence  test  scores. 


IV.  THE  CORRELATION  BETWEEN  “GENERAL 
RANGE”  AND  INTELLIGENCE 


Meaning  of  “General  Range.”  In  the  preceding  section  we 
have  determined  the  relation  between  Information  as  measured 
by  the  I.  E.  R.  Information  Test  and  Intelligence  as  measured 
by  three  intelligence  tests.  It  now  seems  desirable  to  secure  a 
more  comprehensive  measure  of  general  information.  The  abil¬ 
ity  to  solve  the  arithmetical  problems  on  the  lower  levels  and  to 
complete  the  sentences  in  the  lower  levels  may  justly  be  re¬ 
garded  as  information.  It  is  somewhat  difficult  to  distinguish 
between  responses  that  we  would  classify  as  information  and 
responses  that  we  classify  as  power.  In  general,  any  response 
that  comes  readily,  one  that  has  been  directly  associated  or 
connected  with  the  stimulus  that  produces  it,  is  regarded  as 
information.  If,  however,  the  response  is  obtained  by  a  recom¬ 
bination  of  ideas  or  associations,  if  it  is  the  result  of  reasoning, 
if  it  is  one  that  has  not  been  specifically  connected  to  the  stimulus 
that  produces  it,  then  we  may  regard  it  as  power.  With  this  dis¬ 
tinction  in  mind,  it  seems  desirable  to  enlarge  the  information 
scros  by  including  the  scores  on  the  lower  (easier)  levels  of  the 
I.  E.  R..  Arithmetic  tests  and  the  I.  E.  R.  Completion  Tests. 

Accordingly,  a  more  general  Range  score  was  obtained,  as 
follows : 

„  j  Series  I  =  Information  1  +  Arith.  I  +  Completion  I. 

erura  angt  ^  §er;es  jj  —  Information  II  +  Arith.  II  +  Completion  II 

In  building  up  this  general  range  score  the  following  elements 
were  considered  for  inclusion. 

Arithmetic  Range  I  =  Number  right  in  Tests  Al  -f  Cl  +  A  A. 

Arithmetic  Range  II  =  Number  right  in  Tests  Bi  +  C2  +  AAA. 

Completion  Range  I  =  Odds  in  Completion  Test  Al  and  Bi. 

Completion  Range  II  —  Evens  in  Completion  Test  Al  and  Bi. 

Information  I  =  Test  A  +  Test  Cl  +  Test  D2  +  Test  Fl. 

Information  II  =  Test  B  +  Test  Di  +  Test  Ei  +  Test  E2. 

Would  these  Arithmetical  and  Completion  dements  in  the 
General  Range  Score  convert  it  into  a  combined  measure  of 
Information  and  Level?  We  have  defined  a  pupil’s  “level” 
score  to  be  that  group  of  elements  on  which  he  does  50%  of  the 
elements  correctly.  If  any  considerable  number  of  pupils  failed 
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to  secure  a  level  score  as  high  or  higher  than  the  level  in  which 
the  elements  selected  for  inclusion  in  the  General  Range  score 
occur,  then  obviously  we  would  be  combining  both  measures  of 
range  and  measures  of  level. 

To  secure  some  information  about  the  difficulty  of  these  ele¬ 
ments,  an  analysis  of  the  original  data  was  made  to  find  out  the 
difficulty  of  each  test  element.  Table  22  shows  the  percentage 
of  incorrect  responses  to  each  element. 


table  22. 


Percentage  of  Incorrect  Responses  (Arithmetic) 


Element 

T est  A I 

% 

T est  Bi 

% 

Test  Cl 

% 

Test  C 2 

% 

1 

11.7 

8.4 

36.1 

26.1 

2 

4.5 

6.2 

23.9 

15.5 

3 

18.4 

19.5 

26.1 

8.9 

4 

14.5 

3.9 

25.0 

35.5 

5 

2.8 

16.2 

13.9 

27.2 

6 

22.3 

5.0 

30.6 

21.4 

7 

10.6 

12.3 

45.5 

27.2 

8 

3.4 

16.7 

33.9 

27.2 

9 

6.2 

18.4 

34.4 

28.9 

10 

2.3 

23.4 

27.2 

30.0 

Tests  AAA  and  AA  are  not  included  here.  These  were  very  easy  tests  on 
which  the  average  accuracy  was  approximately  80  per  cent.  Hence  they  need 
not  be  considered  in  the  analysis  of  the  arithmetical  elements  to  determine 
whether  measures  of  level  have  combined  with  measures  of  information. 


A  study  of  the  difficulty  of  these  test  elements  shows  that  15 
of  these  40  elements  were  missed  by  more  than  25%  of  the 
pupils.  It  would  appear,  therefore,  that  these  test  elements 
were  of  such  difficulty  as  to  differentiate  the  pupils  according  to 
Arithmetic  Level. 

It  seems  desirable  to  reduce  the  difficulty  of  the  arithmetical 
elements  that  are  to  be  included  in  the  General  Range  Score. 
We  are,  therefore,  limiting  the  measure  of  arithmetic  range  as 
follows : 

Ar.  Range,  Series  I:  Number  of  correct  responses  to  Tests  A  A  and  Ai. 

Ar.  Range,  Series  II :  Number  of  correct  responses  to  Tests  AAA  and  Bi. 

A  similar  study  of  the  difficulty  for  our  group  of  the  Comple¬ 
tion  Test  elements  that  were  considered  for  inclusion  in  the 
general  range  serves  (see  Table  23)  to  show  that  seven  of  the  22 
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elements  were  missed  by  more  than  25%  of  the  pupils.  As  in  the 
case  of  tliei  arithmetic  problems,  this  degree  of  difficulty  is  suffi¬ 
cient  to  produce  considerable  differentiation  among  the  pupils. 

table  23. 

Percentage  of  Incorrect  Res  ponses  ( Completion  Test) 

Test  A  / 

Element  1  2  3  4  5  6  7  8  9  10 

%  Incorrect  12.7  8.9  5.0  7.8  23.3  4.4  27.8  35.0  17.2  2.2 

Test  Bi 

Element  1  2  3  4  5  6  7  8  9  10  11  12 

%  Incorrect  16.1  30.0  14.4  4.4  20.0  10.5  16.7  8.3  23.3  36.6  43.9  31.6 

We  considered  it  desirable  to  reduce  the  difficulty  of  this  pro¬ 
posed  Completion  Range.  This  was  accomplished  by  substi¬ 
tuting  Test  A  A  for  Test  Bl.  The  completion  elements  that  were 
finally  included  in  the  final  general  range  score  were : 

Co.  Range,  Series  I:  Odds  in  A  A  and  Ai. 

Co.  Range,  Series  II:  Evens  in  A  A  and  Ai. 

Composition  of  General  Range  Score.  Our  General  Range 
Score  is  constructed  as  follows: 

(  I.  E.  R.  Information  Tests  Al,  Cl,  Dl,  and  FI. 
General  Range,  Series  I  -  I.  E.  R.  Arithmetic  Test  AA  and  Al. 

(  I.  E.  R.  Completion  Test  AA  and  Al  (odds). 

(  I.  E.  R.  Information  Tests  Bl,  Dl,  El  and  E2. 
General  Range,  Series  II  -  I.  E.  R.  Arithmetic  Problems  Tests  AAA  and  Bl. 

(  I.  E.  R.  Completion  Tests  AA  and  Al  (evens). 

Reliability  of  General  Range  Scores.  The  reliability  correla¬ 
tion  coefficient  between  Series  I  and  Series  11  is  .74;  cerrected, 
r  =  .85. 

Weighting  the  Arithmetic,  Completion  and  Information  Tests 
that  are  combined  to  form  the  General  Range  Score.  The  Com¬ 
pletion  Test  is  much  more  inclusive  than  either  of  the  others ;  it 
inventories  pupil’s  information  about  many  fields  of  knowledge. 
Obviously  it  should  be  weighted  higher  than  either  of  the  other 
tests.  It  was  decided  to  weight  the  Arithmetic  and  the  Comple- 
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tion  elements  approximately  equally,  allowing  the  two  combined 
as  much  influence  as  the  information  elements.  The  standard 
deviations  of  these  tests  are  : 

O'  Information  =  4.9 
O'  co.  Test  =  .81 
O’  ar.  Test  =  2.01 

To  secure  the  desired  weighting  it  is  fairly  accurate  to  multi¬ 
ply  the  Completion  Test  Scores  by  3.  We  are  now  ready  to  de¬ 
termine  the  correlation  between  General  Range  and  Intelligence. 

Correlation  between  General  Range  and  Stanford-Binet.  The 
coefficient  of  correlation  between  the  General  Range  and  the 
Stanford-Binet  Mental  Age  is  (see  Correlation  Table  24)  .74; 


table  24 


General  Range 


60 

61 

62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 

81 

82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

280-9 

1 

270-9 

1 

260-9 

1 

_ 

_ 

250-9 

1 

_ 

_ 

1 

_ 

240-9 

1 

1 

_ 

_ 

4 

1 

1 

1 

1 

•  S 

230-9 

3 

2 

1 

_ 

_ 

1 

_ 

_ 

25 

i 

220-9 

1 

2 

i 

3 

2 

2 

__ 

1 

_ 

‘■'3 

210-9 

1 

3 

3 

3 

7 

1 

3 

3 

__ 

1 

_ 

200-9 

_ 

1 

_ 

_ 

1 

3 

1 

7 

5 

_ 

4 

2 

2 

2 

190-9 

1 

_ 

3 

2 

2 

5 

5 

8 

_ 

5 

Co 

180-9 

__ 

1 

__ 

1 

4 

1 

3 

? 

3 

5 

1 

1 

2 

170-9 

_ 

_ 

2 

_ 

2 

3 

1 

6 

3 

1 

1 

1 

160-9 

2 

1 

2 

_ 

i 

1 

3 

2 

1 

1 

_ 

1 

_ 

1 

_ 

_ 

_ 

_ 

150-9 

1 

corrected  for  attenuation,  r  =  .80.  When  the  scores  were 
combined  without  adjusting  their  relative  weights,  r  was  .69. 
In  this  case  it  should  be  noted  that  arithmetic  scores  contributed 
nearly  three  times  as  much  weight  as  completion  scores,  while 
Information  Scores  contributed  about  eight  times  as  much. 

We  recall  that  the  correlation  between  Information  and  Binet 
was  .62.  The  enlargement  of  the  range  score  to  include  arithme¬ 
tical  information  and  that  type  of  information  involved  in  com¬ 
pleting  easy  sentences  has  increased  the  correlation  to  .80.  Our 
method  of  building  up  the  General  Range  Score  gives  a  great 
deal  of  confidence  in  believing  that  we  have  not  combined  range 
of  information  and  measures  of  level. 
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Range  correlates  considerably  higher  with  Stanford-Binet 
than  does  either  Arithmetic  Level  or  Completion  Level.  AVhether 
Range  correlates  higher  with  Binet  than  would  Arithmetic  Level 
and  Completion  Level  combined  may  be  determined  by  com¬ 
puting  the  multiple  correlation  coefficient,  R.  If  we  compute 
R.  1-23  in  which  1  represents  Stanford-Binet,  2  represents 
Arithmetic  Level  and  3  represents  Completion  Level,  we  find  that 
the  correlation  between  Stanford-Binet  and  Arithmetic  Level 
combined  with  Completion  Level  is  .74  (R  =  .74).  Even  yet 
Range  correlates  higher  with  Binet  than  does  Arithmetic  Level 
combined  with  Completion  Level. 

Correlation  between  General  Range  and  Terman  Group.  The 
raw  coefficient  of  correlation  between  General  Range  and  Ter¬ 
man  Group  Test  is  .73;  the  corrected  coefficient  is  .80  (see  Cor¬ 
relation  Table  25). 

table  25 


General  Range 


60 

61 

62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 

81 

82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

220-9 

210-9 

1 

_ 

__ 

1 

200-9 

1 

_ 

2 

3 

1 

2 

2 

_ 

_ 

190-9 

1 

3 

_ 

2 

2 

1 

1 

_ 

180-9 

1 

1 

1 

6 

5 

4 

_ 

1 

_  _ 

_ 

170-9 

1 

1 

1 

1 

6 

4 

3 

2 

1 

160-9 

9 

__ 

2 

1 

4 

2 

4 

3 

1 

s; 

150-9 

2 

4 

1 

2 

1 

_ 

1 

140-9 

1 

2 

9 

4 

2 

4 

3 

1 

2 

2 

130-9 

_ 

1 

i 

3 

2 

_ 

2 

3 

3 

_ 

i 

120-9 

1 

9 

__ 

1 

4 

2 

3 

110-9 

4 

2 

2 

2 

2 

'sJ 

100-9 

1 

__ 

1 

3 

3 

90-9 

1 

1 

3 

__ 

__ 

2 

i 

_ 

1 

80-9 

1 

i 

i 

70-9 

__ 

__ 

1 

i 

60-9 

1 

1 

Note  that  the  Terman  Group  and  the  Stanford-Binet  are 
equally  closely  correlated  with  our  measures  of  General  Range. 
The  correlation  between  Terman  and  General  Range  is  also 
equal  to  the  correlation  between  Terman  and  Arithmetic  Level; 
it  is  considerably  higher  than  the  correlation  between  Terman 
and  Completion  Level. 
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R  between  Terman  and  Arithmetic  Level  combined  with  Com¬ 
pletion  is  .84.  Thus,  Arithmetic  Level  and  Completion  com¬ 
bined  correlate  with  Terman  slightly  higher  than  does  General 
Range.  The  reverse  of  this  was  true  in  case  of  Stanford-Binet. 

Correlation  between  General  Range  and  Otis  S.  A.  From  Cor¬ 
relation  Table  26  we  find  that  the  correlation  between  General 
Range  and  the  Otis  S.  A.  Test  is  .68 ;  corrected  for  attenuation, 

table  26 


General  Group 


60 

62 

64 

66 

68 

70 

72 

74 

76 

78 

80 

82 

84 

86 

88 

90 

92 

94 

61 

63 

65 

67 

69 

71 

73 

75 

77 

79 

81 

83 

85 

87 

89 

91 

93 

95 

69-72 

1 

1 

1 

1 

2 

1 

1 

65-68 

1 

1 

5 

2 

2 

_ 

1 

_ 

_ 

61-64 

1 

1 

_ 

_ 

2 

1 

2 

2 

2 

1 

1 

_ 

57-60 

1 

2 

2 

_ 

2 

4 

4 

4 

2 

53-56 

1 

1 

_ 

2 

5 

3 

5 

4 

1 

_ 

1 

_ 

_ 

49-52 

2 

2 

1 

2 

2 

2 

6 

3 

1 

2 

45-48 

1 

i 

2 

6 

1 

6 

2 

3 

1 

i 

41-44 

__ 

1 

_ 

__ 

1 

2 

1 

7 

5 

2 

i 

1 

1 

37-40 

1 

__ 

3 

1 

2 

2 

2 

2 

_ 

i 

_ 

1 

_ 

i 

_ 

_ 

_ 

_ 

33-36 

_ 

1 

1 

_ 

3 

1 

2 

_ 

5 

i 

29-32 

1 

1 

25-28 

21-24 

_ 

1 

1 

r  =  .74.  The  correlation  between  Otis  and  Arithmetic  Level  is 
.83 ;  between  Otis  and  Completion  Level,  the  correlation  is  .61. 
Continuing  the  analysis  that  Avas  made  with  Binet  and 
Terman,  by  combining  Arithmetic  Level  and  Completion 
Le\rel,  R  otis  ar.  Level  co  level  =  -85.  As  with  Terman,  so  with 
Otis  S.  A.,  the  correlations  with  Range  are  loAA’er  than,  the  corre¬ 
lations  with  Arithmetic  Level  and  Completion  Level  combined. 


THE  RELATIONSHIP  BETWEEN  COMBINED  SCORES 
ON  THE  THREE  INTELLIGENCE  TESTS 
AND  COMBINED  SCORES  ON  LEVEL 


A  composite  measure  of  the  intelligence  of  each  pupil  was 
made  by  combining  the  scores  on  each  of  the  three  intelligence 
tests.  In  obtaining  the  score  the  tests  were  weighted  approxi¬ 
mately  equally.  Similarly,  a  combined  Level  score  was  obtained 
for  eacli  pupil.  The  coefficient  of  correlation  between  Binet  -f- 
Otis  -f-  Terman  and  Arithmetic  Level  -f-  Completion  Level  is 
.72  (corrected,  .86). 

Similarly,  the  correlation  between  Binet  +  Otis  +  Terman 
and  Arithmetic  Range  -f-  Completion  Range  is  .64  (corrected, 
81),  and  the  correlation  between  Binet  -f-  Otis  -j-  Terman  and 
Arithmetic  Speed  -f-  Completion  Speed  is  .56  (corrected,  .67). 
This  shows  that  Level  (Arithmetic  and  Completion  combined) 
correlates  highest  with  a  composite  of  the  three  intelligence 
tests  (r  =  .86)  ;  Range,  when  limited  to  Arithmetic  and  Comple¬ 
tion  combined  (Information  excluded)  correlated  with  the  Com¬ 
posite  intelligence  scores  .81 ;  and  that  Speed  has  the  lowest  cor¬ 
relation  with  the  composite  of  the  three  intelligence  scores  .67. 


THE  RELATIONSHIP  BETWEEN  THE  INTELLIGENCE 

TEST  SCORES,  ARITHMETIC  LEVEL,  ARITHMETIC 
RANGE  AND  ARITHMETIC  SPEED 

The  following  relations  between  scores  on  the  Stanford-Binet 
test,  arithmetic  level,  arithmetic  range  and  arithmetic  speed  were 
arrived  at  by  the  method  of  partial  correlation. 

(1)  The  correlation  between  Binet  and  arithmetic  level,  with  arithmetic 
range  and  arithmetic  speed  kept  constant  is  .37  (r19.34  —  -37). 

(2)  The  correlation  between  the  Otis  S.  A.  and  arithmetic  level,  with 
arithmetic  range  and  arithmetic  speed  kept  constant,  is  .48  (r12.34  =  -48). 

(3  The  correlation  between  the  Terman  Group  and  arithmetic  level  with 
arithmetic  range  and  arithmetic  speed  kept  constant,  is  .02  (r12.34  —  -02). 
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With  arithmetic  range  and  arithmetic  speed  “partialled”  out. 
arithmetic  level  correlated  highest  with  the  Otis  S.  A. ;  the  cor¬ 
relation  between  arithmetic  level  and  the  Terman  group  test  is 
practically  negligible. 

(4)  The  correlation  between  Binet  and  arithmetic  range,  with  arithmetic 
level  and  arithmetic  speed  kept  constant,  is  .12  (r1,.34  =  -12 ) . 

(5)  The  correlation  between  Otis  .S  A.  and  arithmetic  range,  with  arithme¬ 
tic  level  and  arithmetic  speed  held  constant,  is  .05  (rr,.34  —  .05). 

(6)  The  correlation  between  Terman  Group  and  arithmetic  range,  with 
arithmetic  level  and  arithmetic  speed  kept  constant,  is  .40  (r1„.34  —  .40). 

Of  the  three  intelligence  tests,  the  Terman  Group  is  influenced 
most  by  Arithmetic  Range. 

(7)  The  correlation  between  Binet  and  arithmetic  speed  with  arithmetic 
level  and  arithmetic  range  kept  constant  is,  =  .27  (r12.34  =  — .27). 

(8)  The  correlation  between  Otis  S.  A.  and  arithmetic  speed,  with  arith¬ 
metic  level  and  arithmetic  range  rendered  constant,  is  .23  (r1.,.34  =  .23). 

(9  The  correlation  between  Terman  Group  and  arithmetic  speed,  with 
arithmetic  level  and  arithmetic  range  held  constant,  is  .25. 

THE  RELATIONSHIP  BETWEEN  INTELLIGENCE 
TEST  SCORES,  COMPLETION  LEVEL,  COMPLETION 
RANGE  AND  COMPLETION  SPEED.  By  the  method  of 
partial  correlation,  the  following  relationships  are  found  to 
exist : 

1.  The  correlation  between  Binet  and  Completion  Level,  with  Completion 
Range  and  Completion  Speed  rendered  constant,  is  .53  (r10.34  =  -53). 

2.  The  correlation  between  Otis  S.  A.  and  Completion  Level,  with  com¬ 
pletion  Range  and  Completion  Speed  held  constant  is  .13  (r12<34  =  A3). 

3.  The  correlation  between  Terman  Group  and  Completion  Level,  with 

completion  Range  and  Completion  Speed  rendered  constant,  is  .26 

(G2.34  =  -26)' 

Completion  Level,  when  freed  from  the  influence  of  Comple¬ 
tion  Range  and  Completion  Speed,  is  more  closely  associated 
with  the  Terman  than  with  either  of  the  other  tests. 

4.  The  correlation  between  Binet  and  Completion  Range,  with  Completion 
Level  and  Completion  Speed  rendered  constant,  is  .20  (r10.34  =  .20). 

5.  The  correlation  between  Otis  S.  A.  and  Completion  Range,  with  Com¬ 
pletion  Level  and  Completion  Speed  rendered  constant,  is  .39  (r1.>.al  =  -39). 

6.  The  correlation  between  Terman  Group  and  Completion  Range,  with 

Completion  Level  and  Completion  Speed  rendered  constant,  is  .38 

<r12.34  =  ^). 
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The  two  group  tests,  Otis  and  Terman,  are  about  equally  in¬ 
fluenced  by  Completion  Range ;  they  correlate  higher  with  Com¬ 
pletion  Range  than  with  Completion  Level. 

7.  The  correlation  between  Binet  and  Completion  Speed,  with  Completion 
Level  and  Completion  Range  constant,  is  .31  (r,.,.  ,4  =  .31). 

8.  The  correlation  between  Otis  S.  A.  and  Completion  Speed,  with  Comple¬ 
tion  Level  and  Completion  Range  constant,  is  .29  (rr,..,4  =  -29). 

9.  The  correlation  between  Terman  Group  and  Completion  Speed,  with 
Completion  Level  and  Completion  Range  constant,  is  .02  (r12.34  =  -02). 

Summary  of  Analyses  by  Partial  Correlation.  Summarizing 
the  results  of  the  two  preceding  sections,  we  note  the  following: 


fBinet  Ar  Level  •  Ar  Range  Ar  Speed  =  .37 

TOtis  Ar  Level  •  Ar  Range  Ar  Speed  =  .48 

•"Terman  Ar  Level  ■  Ar  Range  Ar  Speed  =  .02 

•"Binet  Co  Level  •  Co  Range  Co  Speed  —  .53 

•"Otis  Co  Level  •  Co  Range  Co  Speed  =  .13 

**Terman  Co  Level  •  Co  Range  Co  Speed  =  .26 


Mean  —  .30 

•"Binet  Ar  Range  Ar  Level  Ar  Speed  =  .12 

•"Otis  Ar  Range  ■  Ar  Level  Ar  Speed  =  .05 

•"Terman  Ar  Range  •  Ar  Level  Ar  Speed  =  .40 

•"Binet  Co  Range  •  Co  Level  Co  Speed  =  .20 

•"Otis  Co  Range  ■  Co  Level  Co  Speed  =  .13 

^Terman  Co  Range  •  Co  Level  Co  Speed  —  .38 


Mean  —  .26 

•"Binet  Ar  Speed  •  Ar  Level  Ar  Range  =  — .27 

•"Otis  Ar  Speed  •  A  rLevel  Ar  Range  =  .23 

•"Terman  Ar  Speed  •  Ar  Level  Ar  Range  =  .25 

•"Binet  Co  Speed  •  Co  Level  Co  Range  =  .31 

•*Otis  Co  Speed  •  Level  Co  Range  =  .29 

•"Terman  Co  Speed  •  Co  Level  Range  =  .02 


Mean  —  .23 


Thus,  the  mean  of  the  partial  correlation  coefficients  between 
intelligence  tesest  scores  and  Level,  when  freed  from  Speed  and 
Range  (arithmetic  and  completion  range,  not  what  we  earlier 
called  general  range)  is  slightly  higher  tha  nthe  mean  of  similar 
coefficients  between  intelligence  test  scores  and  either  range  or 
speed. 


GENERALIZED  RELATIONSHIPS  BETWEEN  LEVEL, 
RANGE,  SPEED  AND  INTELLIGENCE 


We  have  dealt  with  only  two  of  an  infinite  number  of  possible 
measures  of  level,  namely,  level  in  solving  arithmetical  problems 
and  level  in  completing  sentences.  Obviously  we  could  secure 
measures  of  level  with  respect  to  many  other  functions.  Having 
used  only  these  two  measures  of  level  and  the  three  measures  of 
intelligence,  can  we  determine  the  true  relationships  between 
them  ?  With  the  data  at  hand  we  can  only  estimate  this  relation¬ 
ship.  The  following  formula  for  estimating  this  relationship 
from  our  data  was  suggested  to  the  writer  by  Professor  E.  L. 
Thorndike. 


Tgeneral  level  and  Binet : 


■V 


ar.  level  and  Binet  )  (l*co.  level  and  Binet) 
(Tar.  level  and  co.  level)  (TBinet  and  Binet) 


.65  X  .65 
055)  (.90* ) 


.93 


imilar. 

r  general  level  and  Otis 


{ 

V 


(l“ar.  level  and  Otis  (r  co.  level  and  Otis) 

(far.  level  and  co.  level  )  (r  Otis  and  Otis) 


.83  X  -61 


(.55)  (.90*) 


and 

Tgen  level  and  Terman 


{ 

V 


(Tar.  level  and  Terman  )  (rco.  level  and  Terman  ) 


.80  X  -66 
(.55)  (.90*) 


(.55)  (.90) 

Approx.  1. 


On  basis  of  these  assumptions  the  correlation  between  “gen¬ 
eral  level’’  and  intelligence  is  .97  (mean  of  the  three  coefficients). 

A  similar  analysis  of  the  relation  between  “generalized  range” 
scores  and  intelligence  test  scores,  limiting  range  to  arithmetic 
and  completion  range,  shows  : 


•Estimated. 
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Tgeneral  range  and  Binet  — 


V 

V 


r co.  range  and  Binet  X  Tar  range  and  Binet 
(far.  range  and  co.  range)  (fBinet  and  Binet) 


r general  range  and  Otis 


r general  range  and  Terman~ 


1  .46 

X  -46 

(.43) 

(.90*) 

I  .67 

X  -68 

(.43) 

(.90*)' 

4/  -78  X  .76 

(.43)  (.90*) 


Aprrox.  1. 

=  +8. 


The  mean  of  these  correlations,  .91,  shows  that  “general 
range, 7  7  as  defined  here,  is  slightly  less  closely  related  with 
intelligence  test  scores  than  is  “general  level.'7 

In  the  same  way,  the  relationship  between  “general  speed77 
scores  and  intelligence  test  scores,  is  found  to  be : 


r general  speed  and  Binet 


T  general  speed  and  Otis 


I" general  speed  and  Terman 


V 


.55  X  -49 
750)  (.90*)' 


X  -49 


i 


.50)  (.90*) 

,67~><  -32  ~ 

(.50)  (.90*)' 


.59 


.77 


:  -  .49 


The  mean  of  these  correlations  is  .62. 

This  analysis  shows  that  “speed  in  general77  is  decidedly  less 
closely  associated  with  intelligence  test  scores  than  is  “level  in 
general77  or  “range  in  general. 77 

It  should  be  noted  that  in  this  section  Range  has  been  limited 
to  Arithmetic  Range  and  Completion  Range.  If  with  these  meas¬ 
ures  of  Range  we  had  combined  the  measures  obtained  from  the 
I.  E.  R.  Information  Test,  the  relationship  between  “general¬ 
ized77  range  scores  and  intelligence  scores  would  have  been 
higher.  It  is  important  to  remember  that  “level  in  general77 
correlated  more  closely  with  “intelligence  in  general  7  than  does 
either  of  the  other  qualities. 
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Summary.  This  investigation  has  determined  the  degree  to 
which  speed,  power,  and  range  of  information  are  respectively 
related  to  what  is  measured  by  the  Stanford-Binet,  the  Otis  Self 
Administering  and  the  Terman  Group  Intelligence  Tests.  It  has 
attempted  to  analyze  these  complex  instruments  by  determining 
their  relationships  with  more  clearly  defined  and  more  restricted 
abilities. 

Expressed  in  tabular  form  the  correlations  are  as  shown  in  the 
table  below. 
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Stanford-Binet 

* 

74 

77 

55 

49 

65 

65 

62 

80 

Otis  S.  A. 

77 

-3iv 

88 

71 

49 

83 

61 

71 

74 

Terman  Group 

77 

88 

* 

67 

32 

80 

66 

74 

80 

Arithmetic  Speed 

55 

71 

67 

79 

50 

76 

_ 

_ 

_ 

Completion  Speed 

49 

49 

32 

50 

88 

Arithmetic  Level 

_  65 

83 

80 

76 

_ 

87 

55 

64 

_ 

Completion  Level 

65 

61 

66 

55 

40 

55 

82 

64 

_  _ 

Information  _  _  _  _ 

_  62 

71 

74 

64 

64 

General  Range 

.  .  80 

74 

80 

These  correlations  justify  the  following  conclusions : 

(1)  Speed,  as  we  have  measured  it,  has  the  lowest  correlations  with  the 
Intelligence  Test  scores,  the  mean  of  the  six  correlations  being  .54. 

(2)  Information  (as  measured  by  the  I.  E.  R.  Information  Tests)  correl¬ 
ates  considerably  higher  with  scores  on  the  Intelligence  Tests  than  does 
Speed.  The  mean  of  the  three  correlations  is  .69. 

(3)  Level  is  next  in  the  degree  to  which  it  correlates  with  intelligence 
test  scores;  the  mean  of  the  six  correlations  is  .70. 

(4)  General  Range  correlates  most  highly  with  the  intelligence  test  scores, 
the  mean  of  the  three  correlations  being  .77. 


IMPLICATIONS  OF  THE  INVESTIGATION 

This  investigation  shows  that  scores  made  by  180  pupils  on 
these  three  tests  are  about  equally  closely  related  to  the  factors 
that  we  have  called  Level  and  Range.  While  correlation  should 

*In  correcting  for  attenuation,  the  reliabilities  of  these  tests  were  assumed 
to  be  1. 
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not  be  associated  with  causation,  it  is  probably  valid  to  con¬ 
clude  that  Range  and  Level  are  approximately  equal  deter¬ 
miners  of  the  scores  that  pupils  make  on  these  tests. 

We  are  tempted  at  this  point  to  indulge  in  a  speculation  con¬ 
cerning  the  causes  or  factors  that  contribute  to  Range  and  Level. 
The  writer  is  of  the  opinion  that  one’s  score  on  Level  is  con¬ 
tributed  to  more  by  innate,  natural  capacity  than  by  education. 
It  would  seem  rather  futile  to  attempt  to  teach  a  pupil  to  make 
a  higher  score  on  Level,  particularly  on  completion  Level.  As 
one  matures  or  grows,  he  will  be  able  to  score  higher  on  Level, 
probably  without  much  regard  to  the  content  of  his  education. 
In  the  case  of  Range,  it  seems  that  one’s  score,  while  apparently 
a  simple  function  of  education,  is  in  reality  dependent  upon 
what  we  call  intelligence,  as  well  as  upon  education.  One’s 
Range  is  determined  by  one’s  receptiveness  to,  and  assimilation 
of,  experience  as  well  as  by  one's  variety  or  breadth  of  experi¬ 
ence.  Consequently  Range  is  obviously  a  function  of  intelli¬ 
gence  as  well  as  education. 


APPENDIX  I 


TIIE  RELATION 


BETWEEN  SPEED  AND  ACCURACY 


The  writer  was  interested  in  comparing  the  speed  at  which 
pupils  respond  correctly  on  test  elements  to  the  speed  at  which 
they  respond  incorrectly  to  test  elements  of  about  the  same 
difficulty  for  pupils  in  general.  Some  excellent  teachers  urge 
their  pupils  “to  take  plenty  of  time”  lest  they  make  mistakes;— 
they  argue  that  pupils’  errors  are  due  to  haste,  to  the  careless¬ 
ness  attending  rapid  work ;  other  teachers  of  excellent  repute 
urge  that  pupils  to  work  rapidly,  arguing  that  rapidity  increases 
concentration,  which  in  turn  increases  accuracy. 

To  secure  some  evidence  on  this  problem,  the  20  test  elements 
in  1.  E.  R.  Arithmetic  Tests  Cl  and  C2  were  studied.  The  median 
number  of  seconds  spent  on  the  examples  that  were  done  cor¬ 
rectly  was  compared  with  the  median  number  of  seconds  spent 
on  those  that  were  done  incorrectly.  The  results  appear  in 
Table  27. 
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TABLE  27 


Test 

Element 

No.  Correct 
Solutions 

Median 

No.  Seconds 
Required 

No.  Incorrect 
Solutions 

Median 

No.  Seconds 
Required 

Cll 

115 

15 

65 

15 

02 

119 

22 

61 

23 

03 

133 

19 

47 

20 

04 

135 

31 

45 

84 

05 

155 

13 

25 

24 

06 

125 

26 

55 

49 

07 

98 

45 

82 

55 

08 

119 

20 

61 

30 

09 

118 

65 

62 

56 

C110 

131 

24 

49 

44 

C21 

133 

18 

47 

14 

C22 

154 

14 

26 

20 

C23 

152 

12 

28 

14.5 

C24 

164 

16 

16 

18 

C25 

116 

28 

64 

39.5 

C26 

131 

35 

49 

30 

C27 

142 

14 

38 

42 

C28 

131 

13 

49 

19 

C29 

128 

25 

52 

41 

C210 

126 

30 

54 

33p2 

Median  time  for  correct  solutions,  21  sec.;  median  time  for  incorrect  solu¬ 
tions,  30  sec. 


A  study  of  the  table  shows  that  the  median  time  spent  on  the 
incorrect  solutions  was  greater  on  16  out  of  the  20  test  elements; 
on  three  of  the  examples  the  median  time  spent  on  the  correct 
solutions  was  greater  than  the  time  spent  on  the  incorrect  solu¬ 
tions;  on  one  example  the  medians  were  equal. 

Within  the  range  of  difficulty  represented  by  these  tests,  those 
problems  that  are  solved  correctly  require  appreciably  less  time 
than  those  that  are  solved  incorrectly.  The  writer  suspects,  how¬ 
ever,  that  this  fact  would  not  hold  with  more  difficult  problems. 
Observation  of  pupils’  study  suggests  that  they  tend  to  “size 
up”  a  more  difficult  problem  and  frequently  decide  rather 
quickly  that  it  is  beyond  their  power  to  solve.  Consequently,  if 
omissions  be  included  among  incorrects,  the  reverse  relation 
might  obtain. 

A  similar  analysis  of  the  relation  between  the  time  spent  on 
the  correct  responses  to  the  I.  E.  R.  Completion  Test  B1  and  Cl 
and  the  time  spent  on  the  incorrect  response  (see  Table  28)  bears, 
out  even  more  positively  the  conclusion  drawn  from  the  study 
of  the  arithmetic  problems. 
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table  28 


Test 

Element 

No.  Correct 
Responses 

Median  Time 
Required 

No.  Incorrect 
Responses 

Median  Time 
Required 

Bl  1 

151 

12 

29 

18 

B12 

126 

8 

54 

18 

B 1 3 

154 

11 

26 

12 

B15 

144 

10 

36 

20 

B16 

161 

13 

19 

15 

B17 

150 

12 

30 

13 

B18 

165 

13 

15 

14 

B19 

138 

11 

42 

19 

Bl  10 

114 

10 

66 

13 

Bill 

101 

13 

79 

18 

Bl  12 

121 

12 

57 

23 

B21 

159 

4 

21 

7 

B22 

149 

11 

31 

18 

B23 

144 

6 

36 

23 

B2S 

150 

10 

30 

14 

B26 

127 

14 

53 

15 

B27 

'  91 

1 1 

89 

23 

B28 

140 

16 

40 

15 

B29 

112 

12 

68 

12 

NOTE:  Test  elements  B14,  B24  and  B210  are  omitted  because  of  the 
small  number  of  incorrect  responses,  8  on  B14,  13  on  B24,  and  9  on  B210. 
The  medians  on  these  are  too  unstable  to  make  them  trustworthy. 


Here  we  find  the  median  time  spent  on  the  correct  responses 
lower  than  the  median  time  spent  on  the  incorrect  elements  in 
17  out  of  19  instances. 


APPENDIX  II 

The  correlation  between  a  Composite  of  the  I.  E.  R.  Informa¬ 
tion  and  Level  Tests  and  the  Three  Intelligence  Tests. 

The  Problem.  The  content  of  an  intelligence  test  usually  in¬ 
volves  items  of  information,  arithmetical  problems,  analogies, 
selection  of  best  answers,  word  meanings,  and  classifications. 
The  I.  E.  R.  Tests  used  in  this  study  were  limited  to  items  of 
information,  arithmetical  problems,  and  completion  sentences. 
The  problem  of  this  section  is:  AVill  a  combination  of  these 
tests  correlate  as  high  with  standard  group  intelligence  tests 
(Terman  Group  or  Otis  S.  A.)  as  they  correlate  with  each  other? 

Procedure.  A  composite  score  was  derived  for  each  pupil. 
This  composite  score  was  the  sum  of  the  scores  on  the  I.  E.  R. 
Information  Tests,  the  I.  E.  R.  Problems  Tests  Al,  Bl,  Cl,  and 
C2,  and  the  I.  E.  R.  Completion  Tests  Al,  Bl,  and  B2. 
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The  coefficient  of  correlation  between  the  Composite  Scores* 
and  Otis  S.  A.  Scores  (see  Correlation  Table  29)  is  .87 ;  corrected 
for  attenuation  r  =  .98. 

table  29 


General  Range 


0  3 

6  9 

12 

15  18 

21 

24 

27 

30  33  36 

39 

2  5 

8  11 

14 

17  20 

23 

26 

29 

32  35  38 

41 

69-72 

2 

2  3  .. 

1 

65-68 

1 

3 

4 

4  -  — 

61-64  -  . 

1 

1 

5 

3  2  1 

_ 

57-60 

1 

2  3 

3 

4 

4 

4  4„ 

_ 

V  53-56  —  - 

4 

2  4 

4 

5 

3 

49-52 

1 

2 

1  6 

7 

4 

1 

50  45-48  __  — 

1  1 

4 

4  5 

5 

5 

•5  41-44  —  — 

4  2 

2 

12  1 

_ 

1 

®  37-40  3  __ 

1  4 

5 

1  __ 

2 

33-36  1 

3  3 

_ 

2  4 

29-32  1  — 

1  __ 

1 

25-28  __  — 

1 

21-24  2 

We  have  almost 

reproduced  the 

Otis  S. 

A. 

Test !  The 

Com- 

posite  test  correlates  practically  as 

big] 

li  with  Otis  S.  A.  as  Ter- 

man  group  correlates  with  it  (-88). 

Correlation  between 

Composite 

and  Terman  Group 

Test. 

The  most  interesting  of 

all 

the  correlations  appears  when  the 

Composite  is  correlated 

with 

Terman 

Group. 

See  Correlation 

Table  30. 

TABLE  30 

Composite 

0  3 

6  9 

12 

15 

18 

21 

24 

27  30 

33  36 

2  5 

8  11 

14 

17 

20 

23 

26 

29  32 

35  38 

200-9 

1  1 

1 

190-9 

2 

1 

5  2 

1 

180-9 

2 

5 

2  1 

_  _ 

170-9 

3 

8 

6  1 

_  _ 

t"  160-9 

2 

2 

5 

4 

3 

2  2 

_  _ 

£  150-9 

7 

7 

4 

1 

^  140-9 

2 

3 

5 

__ 

1 

__ 

r  130-9  __ 

1  1 

6 

5 

4 

5 

1 

|  120-9  „ 

3 

3 

3 

1 

4 

2 

t  HO-9  .. 

1  3 

_ 

7 

2 

^  100-9  __ 

2  4 

3 

2 

90-9 

2 

3 

3 

80-9  3  1 

3  1 

1 

70-9  - 

1 

1 

1 

60-9  3 

*The  reliability  coefficient  of  the  Composite  is  .80;  corrected,  .89. 
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Here  the  coefficient  of  correlation  is  .94;  the  corrected  value 
of  r  is  .991.  An  almost  perfect  reproduction.  The  composite 
correlates  appreciably  higher  with  Terman  than  do  the  Otis  and 
the  Terman :  —  .94  as  against  .88. 

The  correlation  between  the  Composite  and  the  Stanford-Binet. 
The  Pearson  r  between  Composite  and  Stanford-Binet  for  our 
180  cases  (see  Correlation  Table  31)  is  .78;  corrected  for  attenu¬ 
ation,  r  =  .83. 

table  31 

Composite 


0  3  6  9  12  15  18  21  24  27  30  33 

2  5  8  11  14  17  20  23  26  29  32  35 


280-9  __  __  —  —  —  —  __  —  __  1 

270-9  __  __  —  __  __  --  —  1 

260-9  --  __  —  —  __  —  1 

*  250-9  __  __  __  __  —  __  —  --  2  — 

240-9  __  —  __  __  __  __  2  3  2  1 

__  230-9  __  ________  2  1  3  2 

5  220-9  __  __________  2  3  5  1  1 

5  210-9  ________  1  2  4  3  6  5  2 

^  200-9  1  _  6  4  5  6  3  2  1 

190-9  1  14  4  5  7  6  1  1  — 

.5  180-9  __  1  1  6  —  8  4  3  __2____ 

03  170-9  2  6  1  5  4  1  1 

160-9  3  1  3  322  1  1 

150-9  __  __  __  __  __  __  __  __  __  __  __  __ 

140-9  1  1 


The  Composite  Test  obviously  does  not  measure  every  thing 
that  is  measured  by  the  Stanford-Binet.  It  does,  however,  cor¬ 
relate  with  Stanford-Binet  higher  than  do  either  of  the  two 
standard  instruments,  Terman  and  Otis. 

Conclusion.  The  combination  of  test  elements  based  upon 
information,  arithmetical  problems,  and  completion  sentences, 
makes  a  test  that  correlates  as  closely  with  the  Terman  Group, 
the  Otis  S.  A.  and  the  Standard-Binet,  as  they  correlate  with 
each  other. 
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